Klimontovich's S theorem in nonextensive formalism and the problem of constraints 



G. B. Bagci* 

Department of Physics, University of North Texas, 
P.O. Box 311427, Denton, TX 76203-1427, USA 
(Dated: February 5, 2008) 

Ordinary Boltzmann-Gibbs entropy is inadequate to be used in systems depending on a control 
parameter that yield diflterent mean energy values. Such systems fail to give the correct comparison 
between the oflt-equilibrium and equilibrium entropy values. Klimontovich's S theorem solves this 
problem by renormalizing energy and making use of escort distributions. Since nonextensive ther- 
mostatistics is a generalization of Boltzmann-Gibbs entropy, it too exhibits this same deficiency. In 
order to remedy this, we present the nonextensive generalization of Klimontovich's S theorem. We 
show that this generalization requires the use of ordinary probability and the associated relative 
entropy in addition to the renormalization of energy. Lastly, we illustrate the generalized S theorem 
for the Van der Pol oscillator. 
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I. INTRODUCTION 



Recently, a new measure of complexity called renormalized entropy (RE) has been proposed [1]. This measure 
is based on Klimontovich's S theorem which states that the renormalized entropy decreases in the process of self- 
organization [2-5]. Originally, the S theorem was used by Klimontovich to remedy the failure of Boltzmann-Gibbs 
(BG) entropy when it is used in open systems. In these cases, BG entropy resulted out of equilibrium entropy values 
greater than the corresponding equilibrium case. In order to solve this problem, he made use of escort distributions 
and energy renormalization. By equating the mean energy vahics, he was able to redefine the intensity of random 
source in such a way that the equilibrium entropy value was maxiniuin once again. Klimontovich's S theorem has been 
used in many fields ranging from logistic map [1]. heart rate variability [6, 7] to the analysis of electroencephalograms 
of epilepsy patients [8]. Later, Quiroga et al. [9] have shown that RE is negative of the KuUback-Leibler (KL) 
entropy [10] i.e., the relative entropy associated with the ordinary Boltzmann-Gibbs (BG) entropy once the reference 
distribution is taken to be the renormalized escort distribution [11, 12, 13]. 

In this paper, we generalize Klimontovich's S theorem and construct corresponding renormalized entropy measure 
in nonextensive formalism [14]. This new approach will allow us to understand open systems from a nonextensive 
point of view. We will illustrate this by solving the model of the Van der Pol Oscilator in the presence of friction 
and energy pumping. One important aspect of this work is that this generalization can only be achieved using the 
ordinary probability distribution rather than the escort distribution. 

In Section II, we present RE within the context of ordinary statistics and show its relation to KL entropy. In 
Section III, we study RE within the framework of nonextensive formalism. The relation of NRE and the associated 
relative entropies is discussed in Section IV. The ordinary and generalized S theorems is applied to the Van der Pol 
oscillator in Section V. The results are summarized in Section VI. 



*Electronic address: gbb0002@unt.eduSunt.edu 



2 



II. RENORMALIZED ENTROPY AND KULLBACK-LEIBLER ENTROPY 

We begin by supposing two different probability distributions i.e. p={pi} and r={rj}. These distributions refer 
to the state of a physical system with different control parameters, for example [1]. Both of them axe normalized to 
unity i.e., 

^p, = ^r. = l. (1) 

i i 

Comparing these two states in order to understand which one is more ordered than the other by using the associated 
BG entropies is in general not possible since the energies in both states may be different, as in the case of Van der 
Pol oscillator [2]. However, it will still be possible to calculate them. For example, for a probability distribution p, 
we can calculate the corresponding BG entropy 

where units are chosen such that the Boltzmann constant k is talcen to be equal to one. Following Ref. [1], we 
introduce the effective Hamiltonian He/ / of the system as 

ffe// = -lnr. (3) 
The escort probability corresponding to the distribution r={rj} is given by 

r.= ^. (4) 
where /3 is a positive integer. Next, we renormalize energies by setting 

{H,fff'> = {H,fff\ (5) 
where superscripts denote the different states. Using Eq. (3), it can be written as 

ri In ri = ^^Pi In Tj. (6) 

i i 

The ordinary renormalized entropy is defined as 

R{p\\r}^s{p)-s{r}. (7) 

By explicitly substituting the Shannon entropies given by Eq. (2), we obtain 

R{p\\r} ^ s{p)-s{r} (8) 

= -'^Pi^J^Pi + '^nlnri. (9) 

i i 

Using Eq. (4) for the second term on the right hand side of the equation, we get 

R{p\\r) = - ^Pilnpi + P^ulnn -J^^i'^^C!- (10) 

i i i 

Using Eq. (6) for the second term on the right hand side of the equation above, 
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i i i 

After a little algebra and using the normalization condition, we see that 

R{pW) = -Y,PiHP^Iri). (12) 

i 

Comparing Eq. (12) with KL entropy [10] which is given by the following equation 

K\p\\r] = Y,PMPi/ri), (13) 

i 

we see the relation observed by Quiroga et al. [9], i.e. 

RipW) = -Y.p^Hpj?i) = -K\p\\7\. (14) 

i 

This final result shows us that RE and K-L entropy is related to one another by a factor of minus one. In other 
words, one can use RE or K-L entropies in order to study self-organization once one employs the escort distribution 
and renormalization of mean energy values. 

III. RENORMALIZED ENTROPY AND TSALLIS ENTROPY 

A nonextensive generalization of the standard Boltzmann-Gibbs (BG) entropy has been proposed by C. Tsallis 
in 1988 [15-18]. The nonextensive formalism has been used successfully to investigate earthquakes [19], models of 
fracture roughness [20], entropy production [21], Ising chains [22] and climatological models [23]. This new definition 
of entropy is given by 

^<i^p) = ^^T^' (15) 

whore Pi is the probability of the system in th(^ ith microstatc, W is the total number of the configurations of the 
system. The entropic index q is a real number, which characterizes the degree of nonextensivity as can be seen from 
the following pseudo-additivity rule: 

S,{A + B)/k = [S,{A)/k] + [S,{B)/k] + (1 - q)[S,{A)/k][S,{B)/k], (16) 

where A and B are two independent systems i.e., pij{A+B)=pi(A)pj{B). As q— > 1, the nonextensive entropy definition 
in Eq. (15) becomes 

w 

Sg^l = -J^Pi^^PU (17) 

i=l 

which is the usual BG entropy already given by Eq. (2). This means that the definition of nonextensive entropy 
contains BG statistics as a special case. The cases q <1, q >1 and q = 1 correspond to superextensivity, subextensivity 
and extensivity, respectively. We define the effective Hamiltonian for this case as 



^e// = ^^^^=K(l/r), (18) 



where q-logarithm is defined as 
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- 1 

1-g 



ln,{x) = (19) 



Note that as q approaches to 1, the effective ffamiltonian given by Eq. (18) becomes identical to the one given 
by Eq. (3) in BG case since q-logarithm given by Eq. (19) becomes equal to natural logarithm in this limiting case. 
Setting the mean energy of the two states to be equal to one another as we have done before is tantamount to writing 



fc ^ fe 

Using the fact that the probability distributions are normalized, we can write Eq. (20) as 



E^r'r, = Y^rr'p,. (21) 



k k 

Using the definition of RE given by Eq. (7), we can form the NRE 



RM^ = -[7r^(Ef^ -J2^k)]- (22) 



We can rewrite the equation above as 



fc fe k k 

Using the ordinary probability definition by taking /3 = 1 in Eq. (4) i.e., 

= g. (24) 



we can write 



Using Eq. (21), we see that 



which is equal to 



E^. = Eg^ = ^^E^^^r- (25) 

k k 



Y.n = ^,Y.P'^rl-\ (26) 

k k 



J27l = ^p,?l-'- (27) 



k k 

Using the relation above in Eq. (23) for the last two terms, we obtain 



RM^ = -(^ + E^fc - ^ T.p'^n-' - T.p'^n-')- (28) 

k k k 



Before proceeding with an analysis of this explicit form of NRE, we need to see the two different expressions of 
relative entropy in nonextensive formalism. 
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IV. NONEXTENSIVE RENORMALIZED ENTROPY AND NONEXTENSIVE RELATIVE ENTROPIES 

In nonextensive formalism, we have two different expressions of relative entropy. The first one is of Bregman type 
[24-26] and is given by 

KMr] = + - ^ Y.P^rr' - ^p,rr\ (29) 

k k k 

whereas the second one is of Csiszar type [27-31] and reads 

/,blH = ^[i-E^^^fc"'']- (30) 

k 

These two forms of relative entropies have also been used in quantum theoretical framework in order to study 

second law of thermodynamics and purity of states in quantum information related contexts [32-35]. In order to see 
the close connection between these relative entropies and K-L entropy, note that it can be written in the following 
form 

m\r] = ^Y.(P^nriV-^\.^i. (31) 

i 

This form is preserved exactly if one uses Jackson g-differential operator [32, 36-38] instead of ordinary differential 
operator above i.e.. 



lMr] = D,J2{Pinnr-\,^u (32) 

i 

where Jackson g-differential operator [36] is defined as 

DJ{x) = [fiqx)-f{x)]Mq-l)]. (33) 

However, there is no such simple correspondence in the case of relative entropy of Bregman type [39]. Yet, one can 
still write 



m\r] = ^ 1.^1, (34) 



where the function G{x) is given by 



G{x) = ^ - ^ - T.P'^rr' + (35) 

fe fe 

Then, we have the following relation between the relative entropy of Bregman type and the function G{x) 



Kg\p\\r] = qDgG{x) . (36) 

Finally, we note that both forms of nonextensive relative entropies are non-negative and equal to zero if and only if 
two distributions are equal to one another preserving these properties shared by K-L entropy [26, 39]. Both of these 
relative entropies become K-L entropy as the parameter q approaches 1. 

In order to see the relation between RE and nonextensive formalism, we compare Eqs. (28), (29) and (30), to see 
that 
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RM^ = -KM7\. (37) 

The nonextensive renormalized entropy cannot be written in terms of relative entropy of Csiszar kind given by 
Eq. (30). In other words, it is possible to obtain an equation in nonextensive case similar to Eq. (14) in ordinary 
case, showing that nonextensive renormalized entropy is nothing but the nonextensive relative entropy multiplied by 
a factor of minus one only by adopting the relative entropy of Bregman type given by Eq. (29). There are three 
important points to be noted. First, we have used Eq. (27) in order to reach Eq. (28). On the other hand, this 
equation itself is based on Eq. (21) which is the renormalization relation in nonextensive formalism corresponding to 
Eq. (6) in ordinary case. This simply shows the necessity of energy renormalization even in nonextensive formalism. 
Second point is the use of Eq. (24). This is nothing but a definition of an ordinary probability distribution with a 
normalization constant C. This is very different than BG case where we have used Eq. (4) i.e., escort distribution. In 
other words, we are forced to use ordinary probability in nonextensive formalism in the same way we are forced to use 
escort distribution within BG statistics (and with its corresponding relative entropy which is K-L entropy). Lastly, we 
have two different relative entropy definitions but we need to use only one of them in order to define the nonextensive 
version of renormalized entropy. In order to assess the importance of the relation given by Eq. (37), we need to 
understand one subtle point: In Ref. [39], it has been shown that relative entropy of Bregman type is associated with 
the ordinary constraint, whereas relative entropy of Csiszar type is the one associated with the escort distribution. This 
shows that the use of ordinary probability and the nonextensive relative entropy associated with ordinary constraint 
is enough to study self-organization in nonextensive formalism if one wants to follow Klimontovich's recipe. 



V. APPLICATIONS 



In this Section, we present first the application of the ordinary renormalized entropy and then nonextensive renor- 
malized entropy to the Van der Pol oscillator and show that Klimontovich's S theorem is satisfied in both cases 
resulting negative renormalized entropy values for all of the involved parameters. 



A. Renormalized Entropy and the Van der Pol Oscillator 



Now, we apply the ideas explained in the previous Sections to the case of the Van der Pol oscillator [2]. The 
equation for this case in the presence of a Langevin source can be given as 



^ =v,^ + {a + bE)v + ulx = y{t), (38) 

where cjq is the eigenfrequeny, b is the nonlinear friction coefficient. The term a can be written in terms of two 
other parameters i.e., 



a = ^ — Qf, (39) 

where 7 is the coefficient of linear friction and a/ is the feedback coefficient. The term E is nothing but the energy 
of oscillation where mass term is taken to be equal to unity. 



E=l(^2+u;„V). (40) 

The random Langevin source term can be defined by the following equations. 

{y{t))=0,{y{t)y{ty) = 2D5{t-t'), (41) 

where the the intensity of random sourc;e D is a given positive constant and not connected with the temperature 
via the Einstein formula. For the case when the following conditions hold 



7, |a|,6(£;) <a;o, 



(42) 
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one can write the following Fokker-Planck equation for the distribution function f{E,t): 

The solution to the equation above for the stationary case is given by 

foiE)=CeM-'-^^). (44) 

where C is the normalization constant. The state of equilibrium corresponds to the case when the feedback 
parameter a/ is equal to zero. Then, the corresponding distribution function, adopting the same notation in previous 
Section, becomes 

r{E) = CeM—^ )• (45) 

Assuming the good oscillator condition [14] i.e., 

b{E) I^^Dbh'^ ^1, (46) 
we obtain the following equilibrium distribution function 

r{E) = ^eM-^)- (47) 

Using the formula (E) = J dEf{E, t)E. in order to calculate the average energy and Eq. (2) in the continuous case, 
we obtain for the entropy 

%) = ln(^) + l. (48) 

and the energy 

{Ef' = (49) 

respectively. The threshold of generation is defined as the state when feedback parameter a/ is equal to 7. Then, 
according to Eq. (39), a—O. Therefore, the distribution function for this case can be written as 

M^) = V;^exp(-— ). (50) 



The corresponding entropy and energy values are calculated as 



and 



sip) = Hf4) + l. (51) 



respectively. So, we have two entropy values corresponding to two distinct values of the control parameter aj. 
Although we would expect the equilibrium entropy to be greater than the off-equilibrium case which is characterized 
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by nonzero control parameter, wee see that this is not the case since the entropy given by Eq. (48) is less than the 
value given by Eq. (51) if we take into account also Eq. (46). In order to solve this problem, we renormalize these 
two states so that their energies will be taken to be equal to one another so that we will have new intensity for the 
random force of the equilibrium state. Therefore, writing 



V TTO 



we obtain the new intensity of the random force as 



(53) 



5(1) 



(54) 



Substitution of this new expression into Eq. (48) gives us the new renormalized entropy 



5(?) 




(55) 



It is easily seen that the renormalized equilibrium entropy in Eq. (55) is now greater than the off-equilibrium 

entropy given by Eq. (51). 

Note that another way to see this is directly to use Klimontovich's S theorem which states that renormalized entropy 
defined by Eq. (7) decreases in this case. This is tantamount to say that the difference of the entropy given by Eq. 
(51) and Eq. (55) is less than zero. If we calculate it explicitly using Eqs. (51) and (55), we see that 



Rg{p\\P, = S{p) - S{Pi = -0.05 < 0. (56) 
This simple observation will be important when we look at the same problem from the nonextensive point of view. 



B. Nonextensive Renormalized Entropy and the Van der Pol Oscillator 

We now apply the abstract formalism, whic;li has been developed in Sections IV and V to the problem of the Van 
der Pol oscillator. We have already studied this example in the context of ordinary renormalized entropy. The only 
difference in treatment will then be the adoption of Tsallis entropy instead of ordinary Boltzmann-Gibbs entropy. We 
will assume the underlying mechanics does not change so that we will use the same distribution functions. Therefore, 
we begin by combining Eqs. (29) and (37) in order to write 

oo oo oo oo 

i?,(p||?) = Sg{p) - 5g(?) = ^ j dEp" - j dET^ + j dEp¥'^-^ + j dEp?''-\ (57) 



The nonextensive generalization of the renormalized entropy requires the use of ordinary probability. This means 
that the average energy values we have already obtained in the context of ordinary renormalized entropy are still valid 
in the nonextensive context. Therefore, we will still use Eqs. (49) and (52) even though we will adopt Tsallis entropy. 
Using the previously obtained distribution functions i.e., Eqs. (47) and (50) in Eq. (57) above, we can calculate the 
first integral on the right hand side as follows 

f .E.. = ,Ei^y,^e-^^,^o , ,58) 

The integral appearing in the second term can be calculated in a similar manner but by using the renormalized 
equilibrium distribution 



The only integral to be solved in Eq. (57) is then the following 



roo POO 

Jo Jo 
This integral can be rearranged as 



The integral above can be solved by the method of completing the squares. Writing 



«Pi-(, - m'^?"E - = -1^1^ + (, - i)(f )./.,^ + (, _ 1)3- 

and doing the following substitution 



we get 



where a is given by 

a=f (.-1) 
The complementary error function erfc{x) is defined as 

oo 

2 f _f2 

erfc{x) = 1 — erf{x) = / e dt, 
V J 

X 

where the error function erf{x) is 

X 

erf{x) = —j= I e~*^dt. 
V Ti" J 



Combining Eqs. (61), (64) and (65), we can write 



rdi?(^)V2(^)('^-i)/2e-('.-i)(iS)^^=^^e-w = 2(^),/2^(,-i)^l 
Using Eqs. (58), (59) and (68), we finally obtain the nonextensive renormalized entropy as follows 



_J_((^)q/2 



a — 1 TT 2D 



9/2„(9-l) 




l/^N(q-l)/2 , 

q^2D' 
^er/c( — (g-1)). 
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The relation given by Eq. (37) guarantees that the NRE hke its ordinary counterpart will take only negative values 
since the relative entropy of Bregman type on the right hand side of Eq. (37) is positive definite (it only becomes 
zero when the two probability distributions are equal to one another) [26]. Due to the minus sign in front of it, the 
NRE is seen to be negative definite for all values of the parameters D, b and q. In Figs. 1 and 2, we plot NRE for 
some particular values of the intensity of the random source D and nonlinear friction coefficient 6 as a function of the 
nonextensivity parameter q. In all these cases, NRE takes only negative values thereby ordering the entropies. The 
NRE Rq{p\\r} attains the value —0.05 as the nonextensivity index q becomes 1 independent of the values of D and b. 
Note that this is exactly the value one obtains by using ordinary RE. 

VI. CONCLUSIONS 

It is known that BG entropy is inadequate to handle the systems which depend on a control parameter [1-4] . In these 
types of systems, one has different entropy and energy values corresponding to different values of the control parameter 
and the maximum entropy value is not necessarily attained by the equilibrium distribution. The solution for this 
problem has been provided by Klimontovich's S theorem which is based on the joint use of energy renormalization 
and escort distribution. This defect is shared by Tsallis entropy since BG entropy is a particular case of Tsallis 
entropy. In this work, we have generaHzed S theorem in the context of nonextensive formalism and showed that this is 
possible only when one adopts ordinary probability distribution. If one uses ordinary distribution and the associated 
relative entropy together with the energy renormalization condition, one obtains a nonextensive renormalized entropy 
that is a generalization of Klimontovich's S theorem. Therefore, what can be achieved in the ordinary BG entropy 
with energy renormalization and escort distribution in the context of S theorem can be achieved through the use of 
Tsallis entropy, renormalization of energy and ordinary probability distribution. As a result, we conclude that the 
use of ordinary probability in nonextensive formalism must not be underestimated since it can be the only form of 
probability distribution needed in some cases such as the generalization of Klimontovich's S theorem. We have also 
applied the nonextensive generalization of S theorem to the Van der Pol oscillator and have shown that the value of 
nonextensive renormalized entropy is negative definite independent of all the parameters involved and attains —0.05 
as the nonextensivity index q becomes 1 exactly giving the numerical value which one would obtain by using ordinary 
renormalized entropy. This new nonextensive measure of complexity could be used in the analysis of logistic maps 
and heart rates as it has been the case with the ordinary renormalized entropy [1, 6, 7]. 
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FIG. 1: The renormalized nonextensive entropy versus nonextensivity parameter q where the intensity of the random source 
D=50 and nonhnear friction coefficient &=0.05 
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FIG. 2: The renormalized nonextensive entropy versus nonextensivity parameter q where the intensity of the random source 
D=5 and nonlinear friction coefficient 6=20 



